Jobfliq.com | Senior Big Data Engineer Job in

Senior Big Data Engineer
Epam
Canada

/ Month

Experience : 2 Yrs | Full Time

Description :

Evaluate different technologies and suggest which technology suits the client's needs
Completes POC and evolves it into a production-ready solution
Selects and integrates any Big Data tools and frameworks required to provide requested capabilities
Implements ETL process
Monitors performance and advises any necessary infrastructure changes
Defines data retention policies
Elaborates on the technical design of new features

Requirements :

At least 2 years of experience with Scala
At least 2 years of experience with Java or Python
Proficient understanding of distributed computing principles
Proficiency with HDFS
Good knowledge of Big Data querying tools, such as Hive and Impala
Proven history of building stream-processing systems, using solutions such as Spark-Streaming
Experience with Spark RDD/DataFrame API using Java/Scala
Experience with integration of data from multiple data sources
Knowledge of various ETL techniques and frameworks
Comfortable with various messaging systems, such as Kafka
Experience with Cloudera platform

Canada

Last date to apply : 30-11-2023

Get Free Registration